This Page Is Inserted by IFW Operations 
and is not a part of the Official Record 

BEST AVAILABLE IMAGES 



Defective images within this document are accurate representations of 
the original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 



BLACK BORDERS 

TEXT CUT OFF AT TOP, BOTTOM OR SIDES 
FADED TEXT 
ILLEGIBLE TEXT 
SKEWED/SLANTED IMAGES 
COLORED PHOTOS 

BLACK OR VERY BLACK AND WHITE DARK PHOTOS 
GRAY SCALE DOCUMENTS 



IMAGES ARE BEST AVAILABLE COPY. 



As rescanning documents will not correct images, 
please do not report the images to the 
Image Problem Mailbox. 
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FIG. 17 
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SI 000 



Convert Scanned Image Data To Selected Color Space 

— — ■ i - ■ ■ - _ 



Estimate Halftone Screen Parameters 
For Converted image Data 

I 



De-Screen Converted Image Data Based On 
At Least One Estimated Halftone Screen Parameter 



Scale De-Screened Converted Image Data 



Generate Gamut-Enhanced Image Data From 
Scaled Image Data 



Generate Edge-Enhanced Image Data And Edge Continuity 
Data From Gamut-Enhanced Image Data 

~ I 



Determine Plurality Of Blobs Within Edge-Enhanced 
Image Data Based On Edge Continuity Data 

+ — 



Remove Bad Blobs 



Create Color Tree 



Cluster Remaining Blobs Into Separate 
Binary Foreground Planes And Grayscale Background Plane 

; + 



Adjust Image Data Within Grayscale Background Plane 



Compress Each Binary Foreground Plane 
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Compress The Grayscale Background Plane ""^ 

i Si 5000 



Generate PDF Document File From Compressed 
Binary Foreground Planes And 
Compressed Grayscale Background Plane 

1 ST 6000 



Output And/Or Store Generated PDF Document File 
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Generate Edge-Enhanced Image 
Data And Edge Continuity Data From 
Gamut-Enhanced Image Data 
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Select First/Next Line Of Gamut-Enhanced Image Data 
As Current Line 
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Select First/Next Pixel Of C urrent Line As Current Pixel 

______ ^ I50 



Select Set Of Neighboring Pixels Adjacent To Current Pixel 
Based On Defined Window 



Identify, For Current Pixel, The Pixels Of The Selected Pixels 
Having Minimum And Max imum Luminance Values 

: ' — * ■ ■ - ~ 



Determine Grayscale Selector Value For Current Pixel Based 
On Gamut-Enhanced Image D ata For Identified Pixels 

' - - _ ■ ■ • 



Convert Raw Grayscale Selector Value For Current Pixel 
Into Edge Continuity Dat a For Current Pixel . 
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Generate Edge-EnhanCed Image Data For Current Pixel 
Based On Gamut-Enhanced Image Data For Current And 
Identified Pixels And Edge Continuity Data For Current Pixel 
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Determine Plurality Of Blobs 
Within Edge-Enhanced Image Data Based 
On Edge Continuity Data 
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Select First/Next Line Of Edge-Enhanced Image Data 
As Current Line 



Select First/Next Pixel Of Current Line As Current Pixel 
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Are^^-^ — S8300 
Edge Continuity Data 
"for Current And Left-Adjacent Pixels The 
Same And Non-Zero For Top 
.Adjacent Pixel? 
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'Edge Continuity Data For 
'Current And Left And Top-Adjacent Pixels 
The Same And Non-Zero For 
Current Pixel? 
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Are 

"Edge Continuity Data For 
Current, Top-Adjacent, And Left-Adjacent 
>ixels All Different Values? 



S8500 



YES 



t-KB 



S8250 



Assign Blob ID Of 
Top-Adjacent Pixel 
To Current Pixel 
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Assign Blob ID Of 
Left-Adjacent Pixel 
To Current Pixel 
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Assign New Blob ID 
To Current Pixel 
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Are 

Edge-Enhanced Image 
Data For Left And Top-Adjacent Pixels 
Sufficiently Similar To That Of 
Current Pixel! 
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Merge Current Pixel And Blobs 
Containing Top-Adjacent And 

Left-Adjacent Pixels Into 
Grayscale Background Plane 



Merge Current Pixel And Blobs Containing Top- 
Adjacent And Left-Adjacent Pixels Into A Single Blob 



S8700 




S8750 



C "Return To^N 
step s9ooo^y 



S8800 



FIG. ^ 



21/24 



/^^emove~~"* >< r~ 
VBad BlobsX 



S9000 

1 _ S9100 



Identify Potentially Bad Blobs — 

+ ' ■ ' ' S9200 
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Remove Identified Inner Blobs 
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(^Identify Potentially Bad Blobs 
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Select First/Next Blob As Current Blob 



Determine Area Of Current Blob 
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Determine Number Of Pixels Of 
Current Blob Having Non-Zero Image Values 
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Determine Aspect Ratio Of Current Blob 
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Mark Current Blob As Good 
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Mark Current Blob As Bad 
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Select Each Blob In Turn A s The Current Blob 
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For Each Current Blob, Add Path In Color 
Tree Based On Edge-Enhanced Image Data 
Of Blob If Path Is Not Already Present 



Determine Number Of Leaves On Color Tree 
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Is Number Of 
leaves Greater Than A Maximum 
Number Of Leaves? 
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Merge At Least Two Leaves Or Nodes Of 
Color Tree Into Single Leaf Or Node 
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Assign Each Remaining Leaf 
A Layer Index Value 
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Assign Each Blob The Layer Index Value 
Of The Leaf Corresponding To That Blob 



Create Blob Color Value 
To Layer Index Value Table 
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Cluster Blobs 




si 1000 



Select First/Next Layer Index As 
Current Layer Index 
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Identify Blobs That Have Been Assigned 
The Current Layer Index 



Determine Bounding Box For Each Identified 
Blob Having Current Layer Index 



Determine Overall Bounding Box That 
Bounds The Identified Bounding Boxes Of 
The Identified Blobs 



Determine Average Edge-Enhanced 
Image Value For Identified Blobs 
Having Current Layer Index 
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Create Binary Foreground Plane Having 
Extent Of Overall Bounding Box And 
Determined Average Edge-Enhanced Image 
Value And Having Binary Values At Each 
Pixel Corresponding To Presence Or 
Absence Of Blob At That Pixel 
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Return To 
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